
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Docket No. 8767.00 

Application of 
Ramin C. Nakisa et al. 
Serial No. 09/651,982 
Filed: August 31, 2000 
FOR: EXPERT SYSTEM 




CLAIM FOR BENEFIT OF 
EARLIER-FILED FOREIGN 
APPLICATION 

NOV 2 8 2000 

Group Art Unit: 2171 

Examiner: Unknown 



CERTIFICATE OF MAILING 

I hereby certify that this correspondence Is being deposited with the United States Postal Service as first 
class mall in an envelope addressed to: Assistant Commissioner for Patents, Washington, D.C. 20231 on 
NOV ^ 2000 (Date of Deposit). ^y. - , 



Shirley Doll 



RECEIVED 



Assistant Commissioner for Patents 
Washington, D.C. 20231 DEC 0 6 2000 

gjj.. Technology Center 2100 

Applicants wish to claim the benefit of the filing date of the earlier U.K. 
Application Serial No. 9920662.5, filed on September 1, 1999, recited in the Declaration 
under the provision of 35 U.S.C. 1 19, and accordingly. Applicants submit herewith a certified 
copy of said British application. 

Respectfully submitted. 




Michael Chan 
Reg. No. 33,663 
Attorney for Applicant(s) 

NCR Corporation, Law Department, ECD-2 

101 West Schantz Avenue, Dayton, OH 45479-0001 

Tel. No. 937-445-4956/Fax No. 937-445-3733 



™S PAGE BLAm 



(USPTO) 



\ 





The Patent Office 
Concept House 



INVESTOR IN PEOPLE 





Cardiff Road 
Newport 



South Wales 
NPIO 8QQ 



I, the undersigned, being an officer duly authorised in accordance with Section 74(1) and (4) 
of the Deregulation & Contracting Out Act 1994, to sign and issue certificates on behalf of the 
Comptroller-General, hereby certify that annexed hereto is a true copy of the documents as 
originally filed in connection with the patent application identified therein. 



In accordance with the Patents (Companies Re-registration) Rules 1982, if a company named 
in this certificate and any accompanying documents has re-registered under the Companies Act 
1980 with the same name as that with which it was registered immediately before re- 
registration save for the substitution as, or inclusion as, the last part of the name of the words 
"public limited company" or their equivalents in Welsh, references to the name of the company 
in this certificate and any accompanying documents shall be treated as references to the name 
with which it is so re-registered. 



In accordance with the rules, the words "public limited company" may be replaced by p. I.e., 
pic, P.L.C. or PLC. 

Re-registration under the Companies Act does not constitute a new legal entity but merely 
subjects the company to certain additional company law rules. 



Signed 




Dated: 11 July 2000 



An Executive Agency of the Department of Trade and Industry 



0 



THIS PAGE BLANK (uspto) 



1 



i 



Pater' .Form 1/77 



I 




V77 



The 
Patent 
Office 



Patents Act 1 

(Rule 16) ''^t^??^:?: -r<6 ^ 

Statement of inventorship and of 
right to grant of a patent 

(See the notes on the back of this form. You can also get 
an explanatory leaflet from the Patent Office to help 
you fill in this form) 



02SEP99 t473702-3 1)02073 

P01/77i)A ij^QQ - 9920662. S 



The Patent Office 



Cardiff Road 
Newport 
Gwent NP9 IRH 



1. Your reference 



8767 



Patent application number 

(The Patent Office xvill fill in this part) 



IDT SEP 1999 



9920662.5 



Full name, address and postcode of the or of 
each applicant {underline all surnames) 



Patents ADP number (i/yozi know it) 

If the applicant is a corporate body, give the 
coimtry/ state of its incorporation 



NCR INTERNATIONAL, INC 

1700 SOUTH PATTERSON BOULEVARD 

DAYTON, OHIO 45479 

UNITED STATES OF AMERICA 

INCORPORATED IN THE STATE OF DELAWARE 



Title of the invention 



EXPERT SYSTEM 



Name of yoiir agent (if you have one) 
"Address for service" in the United Kingdom 
to which aU correspondence should be sent 
(including the postcode) 



Patents ADP number {if you know it) 



F CLEARY 

INTERNATIONAL IP: DEPARTMENT 

NCR LIMITED 
206 MARYLEBONE ROAD 
LONDON NW1 6LY 



If you are declaring priority from one 
or more earlier patent applications, 
give the country and the date of filing 
of the or of each of these earlier 
applications and {if you know it) the or 
each application number 



Coiintry Priority application number 
{if you know it) 



If this application is divided or otherwise 
derived from an earlier UK application, 
give the number and the filing date of the 
earlier application 



Number of earlier application 



Date of Filing 
{day/mon th/year) 



Date of filling 
{day/mon tli/year) 



Is a statement of inventorship and of right 
to grant of a patent required in support of 
this request? {Answer 'Yes' if: 

a) any applicant named in part 3 is not an inventor, or 

b) there is an inventor who is not named as an 
applicant, or 

c) any named applicant is a corporate body. 
See note (d)) 



YES 



Patents Form 1/77 



Patents Form 1/77 

9. Enter the nuSiber of sheets for any of the 

following items you are filing with this form. 
Do not count copies of the same document. 



Continuation sheets of this form 




Description 


15 


Claim (s) 


8 


Abstract 


1 


Drawing(s) 


3 



r 



10. If you are also filing ajiy of the following, 
state how many against each item. 

Priority documents 

Translationof priority documents 

Statement of inventorship and right 
» to grant of a patent (Patents Form 7/77) 

Request for preliminary examination 
(Patents Form 9/77) 

Request for substantive examination 
(Patents Form 10/77) 

Any other documents 
(please specify) 



11. 



1/ We request the grant of a patent on the basis of this application. 



Signature ^ ffa^ I^ate 01-09-1999 




12. Name and daytime telephone number of 

person to contact in the United Kingdom CHRISTINE SHEPPARD 

0171 725 8379 

Warning 

After an application for a patent has been filed, the Comptroller of the Patent Office xvill consider whether publication or 
communication of the invention should be prohibited or restricted under Section 22 of the Patents Act 1977, You xvill be 
informed if it is necessary to prohibit or restrict your invention in this way. Furthermore, if you live in the United Kingdom, 
SecHon 23 of the Patents Act 1 977 stops you from applying for a patent abroad without first getting written permission 
from the Patent Office unless an application has been filed at least 6 weeks beforehand in the United Kingdom for a patent 
far the same invention and either no direction prohibiting publication or communication has been given, or any such 
direction has been revoked. 

Notes 

a) If you need help to fill in this form or you have any questions, please contact the Patent Office on 01645 500505 

b) Write your answers in capital letters using black ink or you may type them. 

c) If there is not enough space for all the relevant details on any part of this form, please continue on a separate sheet of 
paper and wnte "see continuation sheet" in the relevant part(s). Any continuation sheet should be attached to this form, 

d) If you have answered 'Yes' Patents Form 7/77 will need to be filed, 

e) Once you have filled in the form you must remember to sign and date it. 

f) For details of the fee and ways to pay please contact the Patent Office, 



Patents Form 1/77 



8767 

EXPERT SYSTEM 

The present invention relates to an expert system and to a method of providing automated advice. 

The invention has particular, but not exclusive, application to the field of financial sen/ices. 

Recently, the range of financial services products available to the consumer has begun to express a 
dichotomy. The introduction of new technologies, systems and practices, coupled with consumers' 
growing knowledge and confidence in the field of financial affairs have led to the development of 
"execution-only"' sales. In such sales even complex financial products such as pensions and 
investment products - once thought of as requiring "face-to-face" consultation - are being sold on a 
commodity basis. 

The public appetite for such products seems to be growing. Increasing affluence and a diminishing 
welfare state in many developed countries mean that people are considering private personal 
investments as desirable or even necessary. In addition, the pace of everyday life means that they 
have less time to spend planning and consulting advisors on these investments. 

Newcomers to the field of financial services are providing execution-only financial products by a 
number of channels: using a traditional application form, by telephone contact and over the 
Internet, typically fi-om a consumer's own personal computer (PC). All of these channels have a 
significantly lower cost to the provider and avoid the cost of the provision and training of a 
traditional network of human advisers. Consequently, such providers are able to offer a cheaper 
service and/or be more profitable than their more traditional competitors. Established companies in 
the field may be reluctant to enter the execution-only market for fear that their good name will be 
tarnished. Their market share is, therefore, likely to diminish. 

Some consumers may be reluctant to conduct an "execution-only" transaction because of lack of 
confidence in their own abUity in the relevant field. Equally they may be daunted by the prospect of 
a detailed, and possibly rather revealing, interview with a human expert. There is also the fear that 
the advice given must be paid for and there will be substantial hidden charges in whatever product 
or products are recommended. The customer thus needs to obtain the relevant assurance fi-om a 
different source. 
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It is an object of the present invention to ameliorate the above disadvantages. 

In a broad sense, a first aspect of the invention relates to an expert system comprising a 
knowledge base, means for deriving advice from that knowledge base and means for continually 
updating the knowledge base with advice given by human experts. The invention also resides in a 
method of providing an expert system comprising maintaining a knowledge base, deriving advice 
from that knowledge base and continually updating the knowledge base with advice given by 
human experts. 

The term "advice" should be understood to comprise anything that may result from an expert 
consultation, for example a medical diagnosis or the results of a fault-finding procedure on a piece 
of engineering machinery. 

Considering the financial advice scenario, by linking the expert system to the customer profiles and 
decisions made by a company's human financial advisers, the system is continually brought up-to- 
date without any need for particular and time-consuming action on the part of the operator of the 
system. Other benefits include the averaging of advice provided by the human experts and the 
transparency of the advice given. By providing continual, real data from a number of experts 
operating in the field, poor-quality advice given by a small number of the experts will not unduly 
influence the quality of advice given by the system. Consequently, an established company can 
provide services without human intervention and without compromising their reputation - they 
really can obtain the best of both Worids. 

The advice given will preferably, through its cosmetic appearance to the end-user/consumer, be 
associated with the company's brand rather than with a particular adviser. Consequently the 
company need not fear that an adviser will quit the company, taking clients with them. 

The transparency of the system is extremely important should the quality of the advice given 
come into question. The rules applied in any particular case will be readily derivable from the 
system. This ensures that the company or institution which runs the system has the necessary 
information to counter any allegations that advice in any particular case was flawed. 
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It is preferred that the system further comprises means for deriving a plurality of rules in response 
to the knowledge base, wherein the means for deriving advice from the knowledge base comprises 
means for applying the plurality of rules derived from the knowledge base. This may also be 
expressed in method terms as deriving a plurality of mles in response to the knowledge base, and 
deriving advice from the knowledge base by applying the plurality of rules derived from the 
knowledge base. The rules suitably comprise fuzzy rules, whereby the means for deriving advice 
can be arranged to provide a plurality of advice together with a respective indication of suitability. 

To enable explanation to lay persons not versed in machine code, it is preferred that the rules are 
expressed in a natural language. The system may fijrther include means for publishing the rules used 
to derive the advice. 

The means for deriving advice preferably comprises an agent and in any event the system is apt to 
be structured as a distributed system, which is preferred, although the system could be 
implemented as a stand-alone system. 

To maintain a human face, the system preferably further comprises means for providing a user with 
a consultation with a human expert. Such consultation is preferably provided remotely. 

Put more specifically, an aspect of the invention resides in a knowledge-based system adapted 'to 
provide a recommendation tailored to a consumer, comprising: 

a knowledge base containing historical data; 

rule extraction means for extracting a ruleset from the knowledge base; 
a rules database for holding the ruleset; 

codifying means for codifying the requirements of the consumer; and 

recommendation means for applying the ruleset to the codified consumer requirements and 
generating the recommendation accordingly; 
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characterised by rule induction means for providing learning inputs to the knowledge base from a 
plurality of human experts as they advise and make real-life recommendations to actual or 
imaginary consumers, the learning inputs reflecting the recommendations made by the experts and 
the requirements of the consumers that they have advised; and 

update means for running the mle extraction means on the knowledge base to refresh the rules 
database by extracting an updated ruleset from the knowledge base for application by the 
recommendation means to the requirements of future consumers. 

This aspect can also be expressed as a method of building a knowledge-based system adapted to 
provide a recommendation tailored to a consumer, the system operating by extracting rules from a 
knowledge base and applying the extracted rules to codified consumer requirements to generate the 
recommendation accordingly; wherein the method is characterised by providing learning inputs to 
the knowledge base from a plurality of human experts as they advise and make real-life 
recommendations to actual or imaginary consumers, the inputs reflecting the recommendations 
made by the experts and the requirements of the consumers that they have advised; and, after 
learning inputs have been provided to the knowledge base, extracting updated rules from the 
knowledge base for use in generating recommendations tailored to the requirements of future 
consumers. 

The update means suitably operates periodically and the rule induction means provides learning 
inputs to the knowledge base at least as frequently as the update means operates to extract an 
updated ruleset from the knowledge base. It is preferred that the rule induction means operates 
continuously to provide learning inputs as they are made available by the plurality of human 
experts. 

As the possible range of recommendations will change from time to time as some products are 
introduced and others phased out, the update means is preferably adapted to update the knowledge 
base with changing details of recommendations that can be made. 

Fully to understand the consumer's requirements, the codifying means advantageously includes 
means for codifying the perceived needs of the consumer and means for codifying the 
circumstances of the consumer. 
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The mle induction means suitably generates fiizzy sets, and the recommendation means 
suitably applies fiizzy rules. The rule extraction means therefore preferably implements 
Lozowski's algorithm but that algorithm is preferably modified to reduce memory and 
processing requirements. For example, attribute vectors may be generated incrementally, 
keeping only the last attribute vector generated with no storage of attribute vectors. This 
effectively fuses the creation of attribute vectors with the evaluation of T-Norm sets. 

In an elegant arrangement, the attribute vectors can be incremented by generating a first 
attribute vector that contains the first fuzzy set for each attribute, and generating the next 
attribute vector by selecting the next fuzzy set of the first attribute in the first attribute vector. 
If the first attribute contains no more fiizzy sets to select, this technique further involves 
selecting the next attribute that contains more fijzzy sets to select, selecting the next fuzzy set 
of the selected attribute, and selecting the first fuzzy set of each lesser attribute than the 
selected attribute. 

In another modification, a maximum T-Norm value can be generated while T-Norms are being 
generated. The T-Norm and S-Norm generating steps of Lozowski's algorithm are thus 
effectively fused together. 

A fiirther modification involves pruning an attribute tree by eliminating attributes that play no 
part in rule-building. Pruning can be achieved by marking a fiizzy set that returns zero for a 
current dataset example, and omitting evaluation of any attribute vector that includes the 
marked fuzzy set. For example, pruning an attribute vector at class i can involve incrementing 
to the next fuzzy set value for the i-th digit of the vector while resetting any lesser digits to 0. 
If the i-th digit contains no more fijzzy sets, pruning involves incrementing the i+l-th digit. 

Thus modified, Lozowski's algorithm can be applied generally to different aspects of the 
invention. 

Another aspect of the invention resides in a knowledge-based system adapted to provide a 
recommendation tailored to a consumer, comprising: 
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aile extraction means for extracting a ruleset from the knowledge base; 
a rules database for holding the ruleset; 

codifying means for codifying the requirements of the consumer; and 

recommendation means for applying the ruleset to the codified consumer requirements and 
generating the recommendation accordingly; 

characterised by explanation means for explaining to the consumer the reason(s) for the 
recommendation. 

This aspect may also be expressed as a method of operating a knowledge-based system to provide 
a recommendation tailored to a consumer, the system operating by extracting rules from a 
knowledge base and applying the extracted rules to codified consumer requirements to generate the 
recommendation accordingly; characterised by explaining to the consumer the reason(s) for the 
recommendation. 

The explanation means is suitably associated with the rule extraction means for locating the rules 
that govern decisions reached by the recommendation means in making the recommendation, and is 
configured to explain to the consumer the rules on which the recommendation was based. For the 
benefit of understanding by lay persons, the explanation means is preferably configured to express 
the explanation substantially in a natural language. 

As before, the rule extraction means preferably runs Lozowski's algorithm, which may be modified 
as set out above. 

The systems and methods of the invention preferably use XML (Extensible Markup Language) to 
define consumers and possible/actual recommendations. In that event, the recommendation means 
is suitably configured to provide the recommendation as a document based on an XML DTD 
(document type definition). 
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The recommendation means may be configured to suggest a plurality of alternative 
recommendations, in which case it is preferred that recommendations are ranked by their suitability. 

The systems and methods of the invention preferably involve storing a consumer's details for later 
recall. These details can be recalled later in providing a future recommendation, or in completing a 
recommendation v^here input of consumer requirements has been suspended temporarily. 

Provision may be made for obtaining advice from a remote human adviser, for example over a 
video conference link between the consumer and the adviser. 

The systems of the invention are preferably distributed. In the preferred embodiment to be 
described herein, a server holds the ruleset and data on consumers and on possible 
recommendations, a consumer terminal provides an online interface with the server, and a plurality 
of expert terminals are operable by the plurality of human experts. Each expert terminal including 
means for storing recommendations made by an expert and the requirements of consumers that that 
expert has advised, and means for providing that stored data to the server for use in updating the 
ruleset. The ruleset and data on consumers and on possible recommendations are preferably stored 
at the server as XML (Extensible Markup Language) documents. 

The consumer terminal can take any suitable form, preferably being a home PC or a kiosk, booth, 
ATM or other terminal in a financial advice establishment. 

The systems of the invention preferably include an application server enabling consumer 
terminals and expert terminals to interact with the server online, the application server 
providing an online interface to the server for the consumer terminals and the expert terminals. 
The application server can run server-side web applications, a first web application responding 
to calls from a consumer website, and a second web application allowing access to the server 
by authorised expert terminals. These server-side web applications are suitably Java Servlets. 

The recommendation means of the invention may include an agent that applies the rules to the 
codified consumer requirements to generate the recommendation. To escape from a form-based 
interface that could swiftly discourage the consumer, the agent suitably asks a sequence of 
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questions and includes means for adapting later questions in the sequence in accordance with 
answers given to earlier questions in the sequence. That way, the minimum of input is requested 
from the consumer and as much as possible is of relevance to the consumer. 

Other preferred features of the invention will be apparent from the attached claims and the 
following description. 

The present invention will now be explained and described, by way of example, with reference 
to the accompanying drawings, in which: 

Figure 1 shows a schematic diagram of a distributed system in accordance with an 
embodiment of the invention; 

Figure 2 shows a more detailed block diagram of the system shown in Figure 1; 

Figure 3 shows a flow chart of the steps in accordance with an embodiment of the invention; 
and 

Figure 4 shows a flow chart of a rule building algorithm for use with an embodiment of the 
invention. 

Figure 1 shows a system 10 comprising a user's terminal 12 linked to a processor 14 which is 
coupled to a database 16, and a number of financial advisors 18, 20, 22 each having a portable 
Personal Computer (PC) linked (at least periodically) to the processor 14. As each financial 
advisor conducts a fact-find (generating an attribute list) for a customer and issues advice to 
that customer the relevant information is sent to the processor 14 for inclusion in the database 
16. Periodically the processor updates a set of rules which are used to derive advice from the 
information provided by a user at the terminal 12. The frequency of rule up-dating will depend 
upon the quantity of the new information being provided and the volatility of the underlying 
issues upon which advice is being provided. A daily update would be suitable in the case of a 
company offering financial advice. More or less frequent updates could also be provided. 



The user may interact with the system via a World Wide Web (WWW) browser. This has the 
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advantage that the (computer-literate) user is operating in a known, and comfortable, 
environment. The ruleset and information relating to customer and product/services are stored 
at a Web server and an application server running Java (TM) Servlets allow the customer to 
interact on-line. 

The system may operate in a generic sense that the inputs and outputs of the system can be 
customized externally for a particular institution, brand and so on. Using the language XML 
can provide this. XML is in increasingly common usage on the World Wide Web (WWW) - 
XML is a language for defining document types and semantically specifies the information 
they contain. 

XML allows a programmer to abstractly describe a consumer profile, a financial product, and 
a recommendation, as data structures. The presentation of these data can be delegated to a 
separate processor/application. Therefore, the system as described can be utilised by many 
companies, each providing their own formatting instructions in stylesheets so that the visual 
experience of the end-user v^ll be managed in keeping with the company's public image and 
branding requirements. Furthermore, these formatting instructions can contain pointers or 
Universal Resource Indicators (URJs) which will link or replace, in an XML recommendation 
document, a certain type of financial product, with a specific example of that product, 
provided by the company concerned. 

The user's terminal may be replaced by a kiosk in a bank, a terminal in a bank for use by bank 
staff (so that untrained personnel can give advice, and that advice will be consistent for a given 
company, throughout their branch network) or even an Automatic Teller Machine (ATM). 
Other techniques may be used for inputting the information from the advisors 

Figure 2 shows a block diagram of the two arms of the system shown in Figure L These can 
broadly be thought of as the input and output arms. On the left is the output arm which 
comprises a browser, application server and a database server. At the application server an 
Advice Direct Application Servlet or other server-side web application (eg Active Server 
Pages (ASP)) gives the consumer personalised but easy access to the knowledge base. Via a 
presentation engine (this is where the XML/stylesheet merging happens) , this provides an 
applet or form to the user who inputs the answers to the relevant questions. The information 
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provided is parsed and provided to a fuzzy inference system. This inference system obtains the 
rules from a rules database stored at the database server. The inference system uses the rules 
to classify the set of attributes the user has input. Then, through the presentation engine, a 
recommendation is provided to the user. 

On the input arm of the system an applet or form is completed by the experts "in the field" and 
the information is parsed. A Field Intelligence Application Servlet or other server-side 
application allows staff to add to the knowledge base. This includes, for each case, the 
attributes of a consumer and the recommendation given to that consumer by the human 
experts. A recommendation is defined at this level as a value for each of a number of 
classifications (ie true or false for "recommend Individual Savings Account (ISA)). Finally, a 
rule builder application, for example a rule inference system based upon Lozowski's algorithm 
(see below) is activated periodically to update the rules database on the basis of the cases 
input to the knowledge base. 

In Figure 3 after starting at step SlO, the method proceeds to derive a list of required 
attributes for advising in the field in question. This will entail talking to an expert, or 
preferably, a number of experts to determine which are the primary indicators. It is important 
here to remember that the user has limited time and all effort must be made to reduce, and 
preferably eliminate, any superfluous enquiries. In the financial advice scenario, a number of 
financial advisors will be asked what are the crucial attributes such as income, age, marital 
status, existing financial commitments, attitude to risk and so on. These attributes may be 
defined for the purpose of the system as possible values on a linear or binary scale . but it is 
preferred that, in conference with an expert, they are defined as possible values within a fuzzy 
set. Further information on fuzzy sets can be found in "The Fuzzy Systems Handbook: A 
Practitioner's Guide to Building, Using and Maintaining Fuzzy Systems." by Eari Cox and 
published by Academic Press, Inc., 1994. ISBN 0-121-94270-8. When a consensus has been 
reached on which attributes to include, the process proceeds to step S 14. 

At this stage a fiandamental database is set up. This can be populated with a real or imaginary 
dataset. In the case of financial advice, this can be derived from existing customers of a bank 
or other institution offering financial semces. Alternatively, imaginaiy sets of attributes may 
be derived with the intention of providing the best imaginable spread of attribute 
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combinations. The size of the database depends upon the variety of the data set and the 
number of consequent options. Generally speaking, the larger the database, the better the 
advice. In the case of financial advice, it is anticipated that tens of thousands of cases will 
provide a sufficiently robust system for commercial use. 

At step SI 6, the expert or experts are again consulted and the profile of each consumer and 
the corresponding classifications are stored. It is possible for more than one adviser to give 
advice on each case (set of attributes). The Lozowski rule induction system discussed below 
can readily cope with this. If two or more advisers gave the same recommendation then this 
would reinforce the relevant (fuzzy) rule. 
* 

At step S 18 a set of rules are derived from the combination of the consumer profiles and their 
classifications. This is preferably performed to formulate a number of fiizzy rules and a 
preferred technique is given in Shien, Q & Chouchoulas, A (1996)"Generating Fuzzy 
Classification Rules from Crisp Examples" NCR Knowledge Lab-sponsored PhD, Dept. of 
Artificial Intelligence, University of Edinburgh. January 1998. This builds on work described 
in "Crisp Rule Extraction From Perceptron Network Classifiers" by Lozowski, Cholewo and 
Zurada and published in Proceedings of International Conference on Neural Networks, volume 
of plenary, panel and Special Sessions, pp. 94-99, Washington D.C., 1996. 

Briefly, such rule extraction techniques take a set of pre-classified training examples in the 
form of vectors of attributes and the classes to which they belong and extract a set of fuzzy 
rules to accurately partition the input space to fit the classifications. In the case of financial 
advice, the vectors comprise the list of attributes for each customer during the training phase 
(be they real or imaginary customers) and the classes comprise those people who have 
common sets of advice. For example, everybody whose set of attributes led the experts to 
recommend a particular product or combinations of products are classed together. Clearly, the 
larger the number of people in the database the greater the accuracy of the rules. The rules 
generated by this technique are fijzzy and are associated with a degree of certainty (which 
depends upon the strength of support for them provided by the original data set). A 
"tolerance" parameter (which is adjustable) determines the strength required of particular 
rules. If this parameter equals 0.7 (e = 0.7) the system will only use rules which are 70% 
certain or more. 
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One major advantage of the rule-extraction technique discussed above is that it is purely 
mathematical and can thus be transparent to a user. In contrast a system based on a neural 
network (which also learns continually) would not be transparent. This may have an important 
impact on consumer appeal, on acceptability to financial services companies, and on whether 
the system will receive regulatory approval from the relevant bodies in various countries. 

At step S20 an end-user of the system is invited to enter the relevant attributes and a number 
of input techniques will be suitable. This may be sold to the end-user in the form of an agent 
that goes on to conduct steps S20 and S22 of the process. The relevant software, however 
may be provided free by a company whose products are recommended by the software. One 
advantage of using the invention over the traditional human advisor is that the process can be 
interrupted as the user desires. In a preferred embodiment the input is stored for some time to 
come so that a user subsequently only has to update his set of attributes when using the system 
subsequently. 

Once the attribute set is complete (including desires and so-called "soft" factors such as the 
user's attitude to risk) processing proceeds to step S22 at which the fiizzy rules are applied to 
the new set of attributes. There are a number of options available at this point. The advice that 
best matches the attributes could simply be shown to the customer or printed out and an 
option to purchase given to the user. However, since ftizzy rules give a series of graded 
outputs it is possible to provide all of the possible pieces of advice ranked in order of 
suitability (strength of recommendation). The choice between the two can be made by the 
system designer or by the end user. Once the advice has been given, the user can be given the 
option to purchase, or be provided with ftirther information about, any of the products that 
have been advised. 

The rules which were used to provide the advice may also be printed at the request of the user. 

If, at any time, the user feels uncomfortable or out of his depth he may request that he obtains 
a consultation with a human financial advisor. The use of the automated system would not be 
a waste of time because a lot of the information required by the human advisor would already 
be available to him. The interview could be conducted in the traditional manner or via a 
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proprietary Web browser video conference link. The provider may, of course, charge for this 
service, for example on a time basis. ^ 

The advisor may be arranged not to promote any one company's products but may give advice 
in a generic sense, for example, "You should buy a stock-market based pension". 
Alternatively, the adviser may be arranged to provide recommendations in a generic sense to 
further software which then provides the user with details of the relevant product or products 
from the institution/provider operating the system. 

In order to keep the advice generated by the system up to date, it is possible to build 
obsolescence as a parameter for the rule builder applications. Consequently, advice given a 
long time ago is not then used to generate rules. 

At step S28 the data from a number of relevant human experts is entered in to the database 
and, periodically, the rule set is updated by the return of processing to step Si 8. Clearly the 
steps S20, S22, S24 and S26 may be conducted by a different system to that of steps S18 and 
S28. 

The system may divide the relevant field so as to save the user time. For example, the financial 
field may be divided into three categories: 

1 Savings and investments 

2 Life protection 

3 Retirement planning 

Since different (although possibly overiapping) information will be required from the user in 
each of these situations the user may select the field or fields in which he is interested to save 
time. 

Figure 4 shows the known set of steps used in the derivation of the rules using the Lozowski 
rule builder algorithm. Further details can be found in the references identified earlier. What 
follows is a description of certain modifications that have been applied to the described system 
for the embodiment described above. The Lozowski technique derives linguistically expressed 
rules from real-valued examples. The technique was originally proposed to be used in 
conjunction with neural network-based classifiers but it may be used with other classifiers. 
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Indeed, in the financial advice scenario described, it is preferred that a non-neural network 
technique is used so that the rules applied are transparent. While the technique is generally fast 
the number of attributes should be kept to a minimum in order not to unnecessarily impair the 
operation speed. Too few attributes will, however, degrade the results obtained. Of particular 
benefit to many applications, particularly the financial advice application, is the graceful 
manner in which the technique deals with missing data. 

The first modification to the technique concerns the generation of the attribute vectors. While 
this is not particularly time consuming it is extremely demanding of memory. The step that 
required the creation of all of the attribute vectors has been omitted (in its own right) and has 
been fiised with the evaluation of the T-Norm sets. Instead of producing large amounts of 
attribute vectors (i.e. combinations of fiizzy set membership fiinctions for each attribute) 
attribute vectors are generated incrementally by keeping only the last one generated The 
consequence is that the step is combined with the T- Norm generation step - because there is 
no storage of all of the attribute vectors they must be generated at the point of consumption. 

The modified technique starts off with an attribute vector that contains the first fiizzy set for 
each attribute. To produce the next combination we "increase" the fiizzy, set of the first 
attribute (i.e. select the next one for the first attribute). If there are no more fiizzy sets, the 
first one is again selected (it "wraps around") but we increase the next one. If the next one 
was the last one for the next attribute as well, we wrap that one to zero and increase the next 
one. This process resembles the operation of a mechanical tape deck counter, although there 
are fiizzy membership ftinctions instead of digits and each digit may have a different number of 
membership fiinctions from the others. 

In mathematical terms , what this part of the algorithm is doing is a simple process of 
counting. However, the number of the count has potentially different bases for each of its 
digits (as each attribute-digit may have an arbitrary number of fuzzy sets). 

A similar principle is also applied to the T-Norm sets. Processing power and memory are 
conserved by not storing the T-Norm sets temporarily. Instead of storing the T-Norm sets, 
locating the maximum value and storing it as an S-Norm, we calculate the maximum T-Norm 
value while the T-Norms are being generated. T-Norm sets are consequently not generated at 
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all. The T-Norm and S-Norrti generating steps are thus also fused together. 
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The final significant departure from the published technique is pruning of the attribute tree. 
This is based on the observation that when membership of a fuzzy set is zero, the respective T- 
Norm will evaluate to zero (because the minimum membership is kept). Because any other T- 
Norm will be greater than or equal to this one, a zero T-Norm plays no role in rule induction. 

As described above, the attribute vector can be seen as a counter whose digits are each of a 
different base. For example, if we have a four-attribute dataset, where attributes are split into 
five, four, three and four fuzzy sets respectively, the first attribute vector would be 0000 and 
the last one would be 3234 (the first attribute corresponds with the rightmost digit). Going 
through the attribute vector combinations is equivalent to counting (where each digit indexes 
one fuzzy set, starting with fijzzy set 0). Consequently, we would get 0000, 0001, 0002, 0003, 
0004, 0010, 001 1 and so on up to 3234. 

The combinations of all fuzzy sets for all attributes may be seen as a decision tree with depth 
equal to the number of attributes in the dataset. This tree can be pruned to eliminate those that 
play no part in rule-building. Pruning consists of marking a fuzzy set that returned zero for the 
current dataset example as useless. Any attribute vector that includes this fuzzy set will be of 
no use to the algorithm so its evaluation can be omitted. We also stop evaluating sub trees at 
this point. Pruning at class i involves jumping to the next value for the i-th digit while resetting 
any lesser digits to 0. So, pruning an attribute vector encoded as 1021 at the third digit (from 
the right) will result in a new attribute vector 1 100. The second and first digits are reset to 0 
and the third digit increases. If the i-th digit wraps around, the next digit increases to take up 
the addition carry. So, 1222 becomes 2000. Pruning greatly reduces the amount of processing 
required for each dataset line. 

While the present invention has been described in the contact of personal financial advice, it 
should be borne in mind that it is equally applicable to expert systems in other fields, such as 
medical advice, automobile fault-finding and so on. 
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1 . A knowledge-based system adapted to provide a recommendation tailored to a consumer. 

comprising: 



a knowledge base containing historical data; 

rule extraction means for extracting a ruleset from the knowledge base; 
a rules database for holding the ruleset; 

codifying means for codifying the requirements of the consumer, and 

recommendation means for applying the ruleset to the codified consumer requirements and 
generating the recommendation accordingly; 

characterised by rule induction means for providing learning inputs to the knowledge base from a 
plurality of human experts as they advise and make real-life recommendations to actual or 
imaginary, consumers, the leamng mputs reflecting the recommendations made by the experts and 
the requirements of the consumers that they have advised; and 

update means for mnning the rule extraction means on the knowledge base to refresh the rules 
database by extracting an updated ruleset from the knowledge base for application by the 
recommendation means to the requirements of future consumers. 

2. The system of Claim 1, wherein the update means operates periodically and the rule induction 
means provides learrung inputs to the knowledge base at least as frequently as the update means 
operates to extract an updated ruleset from the knowledge base. 

3. The system, of Claim 2. wherein the rule induction means operates continuously to provide 
learning inputs as they are made available by the plurality of human experts. 

4. The system of any preceding Claim, wherein the update means is adapted to update the 
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knowledge base with changing details of recommendations that can be made. 
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5. The system of any preceding Claim, wherein the codifying means includes means for codifying 
the perceived needs of the consumer and means for codifying the circumstances of the consumer. 

6. The system of any preceding Claim, wherein the rule induction means generates fuzzy sets, and 
the recommendation means applies fuzzy rules. 

7. The system of Claim 6, wherein the rule extraction means implements Lozowski's algorithm. 

8. The system of Claim 7, wherein Lozowski's algorithm is modified. 

9. The system of Claim 8, comprising attribute vector generating means for generating 
attribute vectors incrementally. 

10. The system of Claim 9, wherein the attribute vector generating means is arranged such that 
only the last attribute vector generated is kept. 

11. The system of Claim 10, wherein there is no storage of attribute vectors. 

12. The system of any of Claims 9 to 11, and being arranged to fuse creation of attribute 
vectors with the evaluation of T-Norm sets. 

13. The system of any of Claims 9 to 12, comprising incrementing means for incrementing the 
attribute vectors by generating a first attribute vector that contains the first fuzzy set for each 
attribute, and generating the next attribute vector by selecting the next fiizzy set of the first 
attribute in the first attribute vector. 

14. The system of Claim 13, wherein the incrementing means are arranged such that if the first 
attribute contains no more fiazzy sets to select, the next attribute that contains more fuzzy sets 
to select is selected, the next fiizzy set of the selected attribute is selected, and the first fuzzy 
set of each lesser attribute than the selected attribute is selected. 



18 8767 

15. The system of any of Claims 8 to 14, comprising means for calculating a maximum T- 
Norm value while T-Norms are being generated. 

16. The system of Claim 15. and being arranged to fuse generation of T-Norms and S-Norms. 

17. The system of any of Claims 8 to 16, comprising pruning means for pruning an attribute 
tree by eliminating attributes that play no part in rule-building. 

18. The system of Claim 17, wherein the pruning means is arranged to mark a fuzzy set that 
returns zero for a current dataset example, and to omit evaluation of any attribute vector that 
includes the marked fiizzy set. 

19. The system of Claim 18, wherein the pruning means is arranged to prune an attribute 
vector at class i by incrementing to the next fuzzy set value for the i-th digit of the vector 
while resetting any lesser digits to 0. 

20. The system of Claim 19, wherein the pruning means is arranged such that if the i-th digit of 
the attribute vector contains no more fuzzy sets, the i+l-th digit is incremented. 

21. The system of any preceding Claim, and including storage means for storing a consumer's 
details for later recall. 

22. The system of Claim 21, wherein the storage means stores the consumer's details for later recaU 
in providing a future recommendation. 

23 . The system of Claim 21 or Claim 22, wherein the storage means stores the consumer's details 
for later recaU in completing a recommendation, and is associated with means for suspending input 
of consumer requirements. 

24. The system of any preceding Claim, comprising communications means for obtaining advice 
from a remote human adviser. 



system of Claim 24, wherein the communications means comprises a video conference link 



' between the consumer and the adviser. 
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26. The system of any preceding Claim, and being a distributed system. 

27. The system of Claim 26 and comprising a server holding the ruleset and data on consumers and 
on possible recommendations, a consumer terminal providing an online interface with the server, 
and a plurality of expert terminals operable by the plurality of human experts, each expert terminal 
including means for storing recommendations made by an expert and the requirements of 
consumers that that expert has advised, and means for providing that stored data to the server for 
use in updating the ruleset. 

28. The system of Claim 27, wherein the consumer terminal is a home PC or a kiosk, booth, ATM 
or other terminal in a financial advice establishment. 

29. The system of Claim 27 or Claim 28 and further including an application server enabling 
consumer terminals and expert terminals to interact with the server online, the application server 
providing an online interface to the server for the consumer terminals and the expert terminals. 

30. The system of Claim 29, wherein the application server runs server-side web applications, a first 
web application responding to calls fi-om a consumer website, and a second web application 
allowing access to the server by authorised expert terminals. 

31. The system of Claim 30, wherein the server-side web applications are Java Servlets. 

32. The system of any preceding Claim, wherein the ruleset and data on consumers and on possible 
recommendations are stored at the server as XML (Extensible Markup Language) documents. 

33. The system of any preceding Claim, wherein the recommendation means includes an agent that 
applies the rules to the codified consumer requirements to generate the recommendation. 

34. The system of Claim 33, wherein the agent includes questioning means for obtaining the 
consumer's requirements, the questioning means asking a sequence of questions and including 
means for adapting later questions in the sequence in accordance with answers given to earlier 



questions in the sequence. 
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35. A method of building a knowledge-based system adapted to provide a recommendation tailored 
to a consumer, the system operating by extracting rules from a knowledge base and applying the 
extracted rules to codified consumer requirements to generate the recommendation accordingly; 
wherein the method is characterised by providing learning inputs to the knowledge base from a 
plurality of human experts as they advise and make real-life recommendations to actual or 
imaginary consumers, the inputs reflecting the recommendations made by the experts and the 
requirements of the consumers that they have advised; and, after learning inputs have been provided 
to the knowledge base, extracting updated rules from the knowledge base for use in generating 
recommendations tailored to the requirements of future consumers. 

36. The method of Claim 35, wherein the update means operates periodically and the rule induction 
means provides learning inputs to the knowledge base at least as frequently as the update means 
operates to extract updated rules from the knowledge base. 

37. The method of Claim 36, wherein the rule induction means operates continuously to provide 
learning inputs as they are made available by the plurality of human experts. 

38. The.method of any of Claims 35 to 37, comprising updating the knowledge base with changing 
details of recommendations that can be made. 

39. The method of any of Claims 35 to 38, wherein the codified consumer requirements include the 
perceived needs of the consumer and the circumstances of the consumer. 

40. The method of any of Claims 35 to 39, and employing Lozowski's algorithm to extract updated 
rules from the knowledge base. 

41. The method of Claim 40, wherein Lozowski's algorithm is modified. 

42. The method of Claim 41, wherein attribute vectors are generated incrementally. 

43. The method of Claim 42, wherein only the last attribute vector generated is kept. 
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44. The method of Claim 43, wherein there is no storage of attribute vectors 

45. The method of any of Claims 42 to 44, wherein creation of attribute vectors is fused with 
evaluation of T-Norm sets. 

46. The method of any of Claims 42 to 45, wherein the attribute vectors are incremented by 
generating a first attribute vector that contains the first fuzzy set for each attribute, and 
generating the next attribute vector by selecting the next fiizzy set of the first attribute in the 
first attribute vector. 

47. The method of Claim 46 wherein, if the first attribute contains no more fiizzy sets to 
select, the method comprises selecting the next attribute that contains more fijzzy sets to 
select, selecting the next fiazzy set of the selected attribute, and selecting the first fiizzy set of 
each lesser attribute than the selected attribute. 

48. The method of any of Claims 41 to 47, comprising calculating a maximum T-Norm value 
while T-Norms are being generated. 

49. The method of Claim 48, wherein T-Norm and S-Norm generating steps are fijsed 
together. 

50. The method of any of Claims 41 to 49, comprising pruning an attribute tree by eliminating 
attributes that play no part in rule-building. 

51. The method of Claim 50, wherein pruning is effected by marking a fuzzy set that returns 
zero for a current dataset example, and omitting evaluation of any attribute vector that 
includes the marked fiizzy set. 

52. The method of Claim 51, wherein an attribute vector is pruned at class i by incrementing 
to the next fiizzy set value for the i-th digit of the vector while resetting any lesser digits to 0. 

53. The method of Claim 52 wherein, if the i-th digit contains no more fiazzy sets, the i+l-th digit is 



incremented. 
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54. The method of any of Claims 35 to 53, wherein the knowledge base is established by liaising 
with experts to: 

determine the primary parameters of a consumer profile; 

codify the possible values of those parameters; 

generate and run a plurality of case studies; and 

generate an initial set of rules by applying the parameters to the case studies. 

55. The method of Claim 54, wherein each parameter to be taken into account is broken down into 
fiizzy sets and weighted. 

56. The method of Claim 54 or Claim 55, wherein a set of parameters are contained in an XML 
(Extensible Markup Language) DTD (document type definition). 

57. The method of any of Claims 54 to 56, comprising mapping the parameters to 
recommendations resulting fi-om the case studies to generate the initial set of rules. 

58. The method of any of Claims 54 to 57, wherein the initial set of rules is generated by running 
Lozowski's algorithm. 

59. The method of any of Claims 35 to 58, comprising holding on a server the rules and data on 
consumers and on possible recommendations, storing on a remote terminal recommendations made 
by an expert and the requirements of consumers that that expert has advised, and providing that 
stored data to the server for use in updating the rules. 

60. A method of operating a knowledge-based system adapted to provide a recommendation 
tailored to a consumer, the system operating by extracting rules fi-om a knowledge base and 
applying the extracted rules to codified consumer requirements to generate the recommendation 
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accordingly; wherein the method is characterised by providing learning inputs to the knowledge 
base from a plurality of human experts as they advise and make real-life recommendations to actual 
or imaginary consumers, the inputs reflecting the recommendations made by the experts and the 
requirements of the consumers that they have advised; and, after learning inputs have been provided 
to the knowledge base, extracting updated rules from the knowledge base for use in generating 
recommendations tailored to the requirements of fijture consumers. 

61. The method of Claim 60, including storing a consumer's details for later recall. 

62. The method of Claim 61, wherein the consumer's details are stored and later recalled when 
providing a fiiture recommendation. 

63. The method of Claim 61 or Claim 62, wherein the consumer's details are stored and later 
recalled when completing a recommendation, input of consumer requirements being suspended in 
the meantime. 

64. The method of any of Claims 60 to 63, comprising the consumer obtaining advice from a 
remote human adviser. 

65. The method of Claim 64, comprising obtaining said advice over a video conference link. ' 

66. The method of any of Claims 60 to 65, wherein the consumer enters consumer requirements via 
a consumer terminal being a home PC or a kiosk, booth, ATM or other terminal in a financial 
advice establishment. 

67. The method of any of Claims 60 to 66, wherein the consumer enters consumer requirements in 
response to a sequence of questions, and wherein later questions in the sequence are adapted in 
accordance with answers given to earlier questions in the sequence. 
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ABSTRACT 

EXPERT SYSTEM 

An expert system and a method of providing automated advice are described. The system is 
regularly updated by advice (or diagnosis, recommendation etc.) given by practitioners in the 
relevant field. The combination of the underlying facts and the consequent (human) advice is 
used to update a ruleset that is then used to provide automated advice. 

An example of financial advice is given, A database contains the details for the customers of a 
financial institution together with advice and recommendations given previously by the 
institution's human advisors. This database is used to derive a ruleset which is then applied to 
a subsequent customer's details in an automated manner, possibly at the user's own PC via the 
World Wide Web. Frequent updating using data from the human advisors' work means that 
the database (and hence the ruleset) are kept up to date. Consistent advice can thus be 
provided with minimum human interaction. 
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